Phantom-based performance evaluation: Application to brain segmentation from magnetic resonance images

This paper presents a new technique for assessing the accuracy of segmentation algorithms, applied to the performance evaluation of brain editing and brain tissue segmentation algorithms for magnetic resonance images. We propose performance evaluation criteria derived from the use of the realistic digital brain phantom Brainweb. This 'ground truth' allows us to build distance-based discrepancy features between the edited brain or the segmented brain tissues (such as cerebro-spinal fluid, grey matter and white matter) and the phantom model, taken as a reference. Furthermore, segmentation errors can be spatially determined, and ranged in terms of their distance to the reference. The brain editing method used is the combination of two segmentation techniques. The first is based on binary mathematical morphology and a region growing approach. It represents the initialization step, the results of which are then refined with the second method, using an active contour model. The brain tissue segmentation used is based on a Markov random field model. Segmentation results are shown on the phantom for each method, and on real magnetic resonance images for the editing step; performance is evaluated by the new distance-based technique and corroborates the effective refinement of the segmentation using active contours. The criteria described here can supersede biased visual inspection in order to compare, evaluate and validate any segmentation algorithm. Moreover, provided a 'ground truth' is given, we are able to determine quantitatively to what extent a segmentation algorithm is sensitive to internal parameters, noise, artefacts or distortions.